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ESTIMATION  OF  DELAYS  AND  OTHER  PARAMETERS  IN 
NONLINEAR  FUNCTIONAL  DIFFERENTIAL  EQUATIONS 


H.  T.  Banks  and  P.  L.  Daniel 


ABSTRACT 


We  discuss  a  spline-based  approximation  scheme  for  nonlinear  nonautonomous 
delay  differential  equations.  Convergence  results  (using  dissipative  type 
estimates  on  the  underlying  nonlinear  operators)  are  given  in  the  context  of 
parameter  estimation  problems  which  include  estimation  of  multiple  delays  and 
Initial  data  as  well  as  the  usual  coefficient-type  parameters.  A  brief  summary 
of  some  of  our  related  numerical  findings  is  also  given. 


§1  Introduction 


In  [6]  spline  approximation  ideas  are  developed  in  the  context  of  numerical 
algorithms  for  solution  of  functional  differential  equations  (FDE).  The 
theoretical  framework  is  based  on  a  functional  analytic  formulation  (in  an 

appropriately  chosen  Hilbert  space  Z)  of  Ritz-Galerkin  type  ideas  where  one 

N 

approximates  on  finite-dimensional  subspaces  Z  the  underlying  linear  solution 

semigroup  T(t)  (with  infinitesimal  generator  A)  for  the  FDE  by  linear  semigroups 

N  N  N  N  N 

T  (t)  (with  infinitesimal  generators  A  =  P  AP  ,  where  P  is  the  orthogonal 

,  projection  of  Z  onto  ZN) .  These  ideas  were  subsequently  ([3],  [4])  used  in 
developing  numerical  schemes  for  parameter  estimation  and  optimal  control 
problems.  The  fundamental  theoretical  tool  employed  is  the  Trotter-Kato  theorem 
(a  functional  analytic  formulation  of  the  Lax  equivalence  theorem:  stability 
plus  consistency  yields  convergence  of  approximation  schemes)  for  linear  semi¬ 
groups.  In  this  paper  we  present  approximation  results  that  subsume  those  in 
[6],  [3],  and  [4]  in  that  we  develop  schemes  to  estimate  parameters  that  include 
multiple  delays,  coefficients  and  initial  data  for  nonlinear  nonautonomous  FDE. 
Our  theoretical  arguments  avoid  the  Trotter-Kato  linear  semigroup  formulation 
altogether.  Rather,  we  combine  dissipative  type  estimates  with  use  of  the 
Gronwall  inequality  to  develop  a  theory  that  not  only  allows  for  rather  general 
nonlinearities  but  also  accomodates  with  ease  nonautonomous  systems  (both  of 
which  are  features  that  the  Trotter-Kato  linear  semigroup  framework  excludes). 

Of  course,  one  could  use  an  evolution  operator  analogue  of  the  Trotter-Kato 
approximation  theorem  to  obtain  results  for  linear  nonautonomous  equations 
(see  [7]  for  details),  or  a  nonlinear  Trotter-Kato  type  theorem  for  nonlinear 
autonomous  FDE  (see  [13],  [14]).  Both  of  these  separate  approaches  however 
are  less  direct  than  the  one  developed  here  when  applied  to  parameter  estimation 


problems . 


While  Che  approximation  methods  we  develop  can  be  used  with  great  success 
to  simply  solve  initial  value  problems  for  nonlinear  nonautonomous  FDE,  the 
main  focus  of  our  treatment  here  is  parameter  identification  or  estimation. 

That  our  ideas  can  also  be  fruitfully  employed  in  control  problems  is  demonstrated 
in  [9],  [10]  while  application  of  the  methods  to  estimation  problems  for  certain 
partial  differential  equations  can  be  found  in  [5]. 

The  fundamental  ideas  (which  were  first  presented  for  simple  nonlinear 
autonomous,  known  delay,  estimation  problems  in  [l]  and  subsequently  extended 
to  treat  nonautonomous,  unknown  delay,  FDE  problems  in  [ 10] )  are  really  quite 
simple.  However,  the  development  of  a  theory  for  identification  of  the  delays 
is  a  delicate  matter  since  the  "history  space"  for  the  delay  system  changes  as 
one  iteratively  estimates  the  delays.  This,  unfortunately,  results  in  a  rather 
complicated  presentation  from  the  standpoint  of  technical  notation  regardless 
of  the  approach  (e.  g. ,  see  treatment  of  the  linear  autonomous  system  case  in  [*•]) . 

Our  presentation  is  as  follows:  In  section  2  we  describe  a  parameter 
estimation  problem  for  FDE's  and  give  an  equivalent  Hilbert  space  formulation 
involving  an  abstract  nonlinear  evolution  equation.  Section  3  contains  a 
discussion  of  approximate  estimation  problems  based  on  spline  subspaces;  general 
convergence  results  are  given.  We  conclude  with  a  final  section  in  which  we 
present  representative  numerical  findings  obtained  using  the  approximation 
scheme  proposed  in  section  3. 

Most  of  the  notation  (e.g.,  H^  for  Sobolev  spaces,  for  Lebesgue  spaces, 
etc.)  is  quite  standard  and  is  in  accordance  with  popular  usage.  The  symbol 
|*|  will  be  used  in  general  to  denote  the  norm  in  various  spaces  in  instances 
where  no  confusion  will  result.  However  in  some  situations  it  is  absolutely 
essential  to  distinguish  special  weighted  norms.  These  special  norms  will  be 


defined  as  they  are  used  in  the  discussions  below.  For  convenience  of  the 
reader,  we  have  summarized  these  definitions  in  a  brief  appendix  for  quick 
reference. 

Finally  we  wish  to  mention  the  motivation  behind  our  efforts  to  develop 
the  methods  presented  below.  In  [4]  and  [10]  one  finds  brief  descriptions  of 
nonlinear  delay  equation  estimation  problems  arising  in  the  study  of  enzymatically 
active  column  reactors.  Although  such  problems  actually  prompted  the  theoretical 
investigations  that  we  report  here,  a  discussion  of  the  application  of  our 
methods  to  these  problems  would  be  quite  lengthy  and  thus  will  be  the  subject 
of  a  separate  report. 
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§2  Formulation  of  parameter  estimation  problems  for  nonlinear  FDE 


In  the  present  section  we  describe  the  parameter  estimation  problem  for  a 
delay  differential  system  and  detail  conditions  under  which  solutions  exist. 
Our  approach  then  is  to  reformulate  the  FDE  -  governed  identification  problem 
as  an  abstract  problem  on  an  infinite-dimensional  state  space,  concluding  the 
section  by  establishing  the  equivalence  between  the  FDE  and  the  abstract  state 
equation. 

We  consider  the  vector  nonlinear  delay  equation 


(2.1) 


x(t)  ■  f(o,  r^,  t,  x(t),  xt,  x(t-r1) , 
(x(a),  xa)  -  (n,  <t> ) 


x(t-r^))  +  g(t),  a  <  t  <  b 


where  3^  denotes  the  Rn-valued  function  0  •*  xfc(0)  *  x(t  +  0) ,  -  r  <  0  <  0,  and 
g  is  a  general  l”  (a,  b)  perturbation  term.  The  equation  depends  on  the  parameters 
y  ■  (s,  q)  ,  where  c  *  (n,  4>)  is  the  initial  data  in  some  set  SC  M,  with 


W  =  {(4/(0),  4/)ERn  *l“(-  r,  0)  |4»eH1(-  r,  0)}. 

The  parameter  q  •»  (a,  r^,  ....  r^)  is  assumed  to  be  in  Q  *  A  x  R  where  a  is  a 
coefficient-type  parameter  in  the  set  A  c  Rv  and  the  discrete  delays  are  chosen 
from  the  set 


R  *  f (rj» 


r0  ±  ri  ± 


<  r  <  r,  r  >  0} 
—  v  —  v 


with  r  >  0  fixed  and  given  throughout  this  paper. 

To  simplify  notation  we  shall  use  |*j  to  denote  the  norm  on  l!J(-  0) 

v  n 

while  we  use  j*|  to  denote  the  norm  on  L^-  r,  0)  and  I^a,  b).  We  make  the 
following  standing  assumptions  on  f  throughout  the  paper: 
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(HI)  The  mapping  f  satisfies  a  global  Lipschitz  condition  on 

R°  *  L!j(-  r*  ^  *  ^nV  uni^ormly  in  (a»  r  )  e  A*[0,  r].  That 

is,  there  exists  m^  e  l^a,  b) ,  >  0,  such  that  for  all 

(5«  w^) ,  (6,  x»  yv  •••»  yv)  £  Rn  *  r»  0)  *  RnV, 

|f(a,  rv,  t,  C,  <l».  wx,  ....  w^)  -  f (a ,  rv>  t,  6,  x.  yj.  •••.  yy)  ! 

V 

1  n^t)  (U  -  <S|  +  U  -  xl  +  Z  |w4  -  y±  | ) 

v  i=l 

for  all  (a,  r  )  e  A  x [o,  r]  and  a. a.  t  e  [a,  b]. 

(H2)  For  each  (a,  r^)  e  A  *  [0,  r], 

f(a,  r^,  [a,  b]  x  Rn  x  l"(-  r,  0)  *  RnV  -►  Rn 

is  differentiable,  and 

t  -*•  f (a ,  rv,  t,  (HO),  ip,  \p(-  r^,  ....  <K~  r^))  is  in  H1(a,b) 

for  every  ip  t  Cn(-r,0)  =  C([-r,0];Rn)  and  every  (a,  r  ,  ....  rv)  r  A*  U. 

(H3)  Given  any  x  c  Cn[a-r,b],  the  mapping 

a  ->  ft  (a,rv,o,x(a)  ,x(j,x(a-r1)  .  ,x(a-ry))  is  in 

L^(a,b)  for  all  q  e  Q. 

(H4)  The  function  f  is  continuous  on  A  x  [o,  r]  *  [a,  b]  *  Rn  *  l”(_  r?  0)  *  RnV. 


Remark  2.1  It  follows  immediately  from  (HI)  and (H2)  that  f  satisfies  an  affine 
growth  condition;  that  is,  for  a  given  x  e  L^a  -  r,  b) , 

(2.2)  |f(a,  rv,  t,  x(t),  xt>  x(t  -  r^,  ....  x(t  -  r^))| 

v 

_<  m  (t)  f  |x(t)  |  +  |xt(r  +  E  |x(t  -  r4)  j }  +  m2(a,  r^,  t) , 

v  i=»l 

where  m.^fa,  ry,  t)  =  |f(a,  ry,  t,  0,  0)|  is  in  I^a,  b).  Quite  standard 

arguments  may  then  be  employed  to  demonstrate  that,  for  each  q  c  Q, 


AMHtAMiEik 
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t  -»  f(a, r^,  t,  x(t),  xt,  x(t  -  r^) . x(t  -  r^) )  is  in  L^(a,  b)  and  that  the 

mapping  depends  only  on  the  equivalence  class  of  x;  therefore  there  will  be  no 
difficulty  associated  with  point  'evaluations  of  x  appearing  in  f  since  we  shall 
write  (2.1)  as  an  equivalent  integral  equation. 

Before  we  direct  our  attention  to  the  estimation  of  the  parameters  appearing 
in  (2.1)  we  shall  first  state  results  guaranteeing  the  existence,  uniqueness  and 
continuous  dependence  of  solutions  to  the  state  equation  for  each  choice  of  param¬ 
eters  (?,  q)  e  S  x  Q. 

Theorem  2.1  Let  y  ■  (£>  <0  ”  (h,  4> *  a,  r^,  ....  r^)  be  given  in  S  x  Q.  There 
exists  a  unique  solution  x  to  (2.1)  on  the  interval  [a  -  r,  b]  which  depends 
continuously  on  (n,  <p,  g}  in  the  R  x  L^(-r,0)  x  L^a.b)  topology. 

In  the  proof,  which  may  be  found  in  [10,  p.  6]  and  will  not  be  detailed  here,  one 
employs  general  uniform  contraction  principles  (see  [12,  p.  7])  and  relies  heavily 
on  hypothesis  (HI)  and  the  growth  condition  (2.2). 

We  turn  now  to  an  examination  of  (2.1)  when  the  parameters,  including  the 
delays  r^»  ...,  r^,  and  initial  data  (n,  $)  are  to  be  estimated.  We  will  restrict 
our  attention  to  parameters  in  the  admissible  initial  data-parameter  set 
T  "  S  x  Q  where  we  assume  throughout  that  T  has  the  following  property: 

(H5)  Q  is  compact  in  RW+V  and  S  C  W  is  compact  in  the  Rn  *  L^(-  r,  0) 

topology. 

The  identification  problem  consists  of  finding  y  e  T  which  provides  the  best 
least  squares  fit  of  the  parameter-dependent  solution  (of  the  model  equations 
(2.1))  to  observations  of  the  output  at  discrete  sample  times.  The  problem, 
which  could  also  be  reformulated  as  a  maximum  likelihood  estimation  problem. 
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may  be  formally  stated  as  follows: 

A  A  g 

Given  g  and  observations  {u^},  e  R  ,  at  times  {t^},  i  =  1,  ....  M, 
find  y  in  f  which  minimizes 

1  M  -2 
(2.3)  J(Y)  =  ~  7.  |C(q)x(t  ;  Y)  -  uJ 

*  i=l 

over  all  y  =  (C,  q)  in  F.  Here  C  is  a  given  s  x  n  matrix  continuous  in 
q;  and  u(t;Y)  =  C(q)x(t;y)  represents  the  "observable  part"  of  x(t;y),  the 
solution  to  (2.1)  corresponding  to  y. 

Remark  2.2:  For  y  =  (n,  <p,  a,  r^,  ...,  r^)  the  optimal  parameter,  it  may  happen 

that  r^  <  r  so  that  we  actually  only  need  <j>  defined  on  [-  r  ,  0]  to  integrate 
the  state  equations  (2.1)  (and,  in  fact,  the  $  we  obtain  in  practice  will  be 
defined  on  that  interval  only).  We  will  view  $  as  a  function  on  all  of  [-  r,  0] 
by  making  an  arbitrary,  but  definite,  continuous  extension  from  -  r^  back  to  -  r, 
so  that  (n,  $)  is  an  element  of  S  as  required. 

Remark  2.3:  The  compactness  assumption  on  S  will  not  be  difficult  to  satisfy 

in  practice  since  a  sufficient  condition  for  compactness  is  that  all  elements 
(n,  4>)  in  S  are  such  that  n  belongs  to  a  compact  set  in  Rn  and  <|>  is  bounded  in 
H^(-  r,  0).  An  example  of  one  such  admissible  initial  data  set  is  the  set  of 
all  polynomials  on  [-  r,  0]  of  order  _<  k  (k  a  nonnegative  integer)  with  coefficients 
in  a  compact  set. 

§2.1  An  abstract  reformulation  of  the  estimation  problem 

We  next  reformulate  (2.1)  as  an  abstract  evolution  equation  in  an  infinite- 
dimensional  state  variable.  Our  approach  involving  use  of  the  state  space 
Rn  x  L“  (-  r,  0)  is  quite  standard  and  well-established  in  the  FDE  literature 
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(see,  for  example,  [2]  and  the  references  therein);  however,  the  dependence  here 

of  operators  and  state  spaces  on  unknown  parameters  requires  that  we  make  such 

definitions  in  this  and  the  following  section  with  a  certain  amount  of  care. 

We  will  let  Z  =  Rn  *  l!*(-  r,  0)  with  norm  |*|  induced  by  the  inner  product 
0  1 

<(£.  ^),(f,x)>  9  +  /  For  t)  e  Q  *  [a,  b],  (£,  e  Rn  *  Cn(-r,0) 

-r 

define  F(q,  t,  5,  i^)  =  f(a,  rv,  t,  £,  ^ ,  ijK-r^,  •••.  v(-rv))  and  A(q,  t) :  W  -*  Z  by 
(2.4)  A(q,  t)(<K0),  <P)  -  (F(q,  t,  *(0), 

where  V*l>  denotes  the  l"  (-  r,  0)  function  that  is  the  derivative  of  ^ .  In 
addition,  let  G(t)  =  (g(t),  0)  e  Z,  for  t  c  [a,  b]. 

The  equivalence  of  the  FDE  (2.1)  to  an  abstract  evolution  equation  is 
detailed  in  Theorem  2.2;  before  proceeding,  however,  we  need  two  results  that 
also  will  be  called  upon  frequently  in  §3,  so  they  are  stated  here  as  lemmas. 

Our  first  proposition  is  actually  a  restatement  of  the  well-known  result  [8,  p.  100] 
that  —  |x(t) |2  -  <x(t),  x(t)>. 

Lemma  2. 1.  If  X  is  a  Hilbert  space  and  if  x:  [a,  b]  -*■  X  is  given  by 
t 

x(t)  *  x(a)  +  /  v(o)do  ,  then 
a 

y  n  t 

| x( t) |  =  |x(a)|  +2  /  <  x(ct),  v(a)  >  da. 

a 

The  second  result  describes  how  to  construct  an  equivalent  topology  for  Z 
so  that  the  nonlinear  operator  A  satisfies  a  dissipative-type  inequality.  The 
lemma,  a  nonlinear  version  of  that  found  in  [2,  p.  186]  and  [6],  greatly  simplifies 
our  calculations  and  is  the  foundation  for  our  development  without  the  use  of 


semigroups. 


Lemma  2.2.  Let  q  »  (a,  r^,  ....  r^)  c  Q  be  given.  For  y  ■  (£,  \p) , 

T 

z  *  ($»  x)  £  Z  define  a  new  inner  product  on  Z  by  <y,  z>  =  f,  5  + 
o  ^ 

/  ^ ( 0) x(P) p(q) (P)dO  where  p(q)  is  given  on  [-  r,  0]  by 


1,  0  e  [-  r,  -  r  ] 


(2.5)  p(q)(0)  =  <  2  ,  G  e  (-  ryt  -  rv_j] 

•  • 

•  • 

vfl ,  0  e  (-  r^,  0], 


Then, 

2 

<A(q,  t)y  -  A(q,  t)z,  y  -  z>  <  ui(t)|y  -  z| 

q  —  q 

for  all  q  e  Q,  almost  all  t  c  [a,  b]  and  all  y,  z  e  W.  The  function  cj  >  0  is 
in  L^a.b)  and  is  given  by  w(t)  =  m^t)  +  —  ^  1  +  ^  m^(t). 


Proof:  Let  y  *  (iHO) ,  40,  z  «  (x(0),  X)  e  W. 


<A(q,  t)y  -  A(q ,  t)z,  y  -  z>q  * 

[F(q,  t,  <K0),  *)  -  F(q,  t,  X(0),  x)]T|>(0)  -  x(0)] 

°  /v 

+  /  (tty  -  PxH'J’  -  x) (Q)p(q) (0)d0 


where 


/  (tty  -  Px)(*  -  x)(0)p(q)(0)d© 


2 


K  2  - 


I*(-  rv)  -  x(“  rv)l 


C~  r)  -  x(-  r J 

2 


(v  +  1) 


v-i  |*(-  rj)  -  x(-  rj)l2  U<-  rv>  -  x(-  rv>  1 2 
"  ill  2  2  '  2 


1  — -t- 1}  k(0)  -  x(0)  1 2  -  l 

j-1 


^  |<K-  r  )  -  x (“  r .)  I 


Therefore,  for  almost  all  t  e  [a,  b], 


<A(q,  t)y  -  A(q ,  t)z,  y  -  z> 


<  m1(t)|i|»(0)  -  x(0)  |  2  +  m1(t)|+  -  X|r  |<H0)  -  x(0)  | 


V 

+  l  l*(-  r  )  -  x  (~  r  )|  (m-  (t)  |</<(0)  -  x<0)  f ) 

j»l  J  ->  L 


+  }L±1  |^(0)  -  x(0)j2  -  i  l  j^(-  r  )  -  X(-  r  )  j 

4=1  J  J 


_<^m1(t)  + 


m  (t)  vm  (t)  ..  ,  m  (t)  , 

2  +  — 2 -  +  — 2 — )  “  x(0)  I  +  ~2 - I  ^  ”  xlr 


2  h2 

where  we  have  used  repeatedly  the  fact  that  ah  1  y-  +  y-  .  It  follows  then 


<A(q,  t)y  -  A(q,  t)z,  y  -  z>q  £  w(t)|^(0)  -  x(0) | 


+  w(t) U  -  x\ 
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I  I  'V 

It  is  clear  that  for  all  q  e  Q,  the  norm  |*|  on  Z  induced  by  the  p(q) 

a, 

weighted  inner  product  is  equivalent  to  the  usual  Z  norm  since  1  <_  p(q)  <_  v  +  1. 

Theorem  2.2  For  fixed  y  e  F  let  y(t;  y,  g)  *=  (x(t;  y.  g)  *  xt(Y.  g)),  where 
x  is  the  solution  to  (2.1)  corresponding  to  y  =  (n,  a,  r^,  ...»  r  )  and 
g  e  L^Ca,  b).  Then  y(Y*  g)  is  the  unique  solution  on  [a,  b]  of 

(2.6)  z(t)  ■  C  +  (A(q,  a)  z (a)  +  G(a)}da  . 

a 

Furthermore,  y(t;  y»  g )  e  Z  is  continuous  in  t  e  [a,  b],  and  uniformly  continuous 
in  {<;,  g}  e  W  x  L"(a,  b)  (in  the  Z  *  L^Ca,  b)  topology)  uniform  in  t  e  [a,  b]. 

Proof:  We  shall  sketch  the  proof  of  the  theorem,  which  demonstrates  that  (i) 

the  integrand  in  (2.6)  is  well-defined  and  integrable,  (ii)  the  equality  in  (2.6) 
hold6  for  z(t)  =  y(t;  y,  g),  and  (iii)  the  solution  y  is  unique  and  continuously 
dependent. 

To  prove  (i)  we  first  must  show  that  y(t;  y,  g)  e  dom  (A(q,  t))  *  W  for  each 
t  e  [a,  b],  or,  since  xt(0)  «  x(t),  that  x^  e  H  (-  r,  0)  for  all  t.  Using  the 
affine  growth  condition  (2.2)  on  f  and  the  continuity  of  x  it  is  not  difficult 
to  show  that  t  ■*  f(a,  r^,  t,  x(t),  x t>  x(t  -  r^) ,  ...,  x(t  -  r^))  is  square- 
integrable  on  [a,  b]  so  that,  using  the  fact  that  x  ■  {  on  [a  -  r,  a]  ,  we 
obtain  x  e  (a  -  r,  b) .  Standard  estimates  in  Lll,  p.  254 J  may  be  invoked 

to  demonstrate  that 

(2.7)  (*t+e  -  xt)  -*■  (x)t  in  l!}(-  r,  0) 

ao  that  V  (*t)  ■  (x)^  e  l"  (-r,  0),  for  each  t  e  [a,  b].  Arguments  similar  to 
these  may  be  used  to  show  A(t)y(t)  +  G(t)  is  integrable  on  [a,  b],  concluding 
the  proof  of  (i). 
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The  argument  that  y(t)  »  (x(t;  y,  g) ,  xt(y,  g))  satisfies  equation  (2.6) 
is  trivial  if  this  equation  is  examined  componentwise:  The  Rn  part  of  (2.6)  is 
simply  a  restatement  of  (2.1)  while  the  desired  equality  for  the  L2(-  r*  0) 
component  follows  immediately  from  (2.7). 

Finally,  uniqueness  and  continuous  dependence  of  solutions  on  {£,  g} 
follow  from  arguments  that  will  be  repeated  often  throughout  this  paper  and  will 
be  presented  in  detail  here  for  the  case  of  continuous  dependence;  uniqueness 
also  follows  from  these  arguments.  Let  z^,  z denote  solutions  to  (2.6) 
corresponding  to  g^,  { c 2 »  82)  respectively  with  q  c  Q  fixed.  Then,  for 

t  t  [a,  b], 

*j_(t)  -  z2(t)  *  ?i  “  ?2  +  /C  ^A(o)z1(o)  -  A(o)z2(a) 

a 

+  (g1(o),  o)  -  (g2(°).  0)}da 

so  that  from  Lemma  2.1, 


t 

+2  /  <A(a)z  (a)  -  A(a)z2(a),  z  (0)  -  z2(a)>  da 

a  q 

t 

+  2  /  |(g1(o)  -  g2(c),  0)|  |zx(o)  ~  z2(o)|  do 

a  q  " 

o  t  2 

-  I51  '  +  2  /  -  z2(c0|  da 

q  a  q 

t  ~  t  9 

+  /  UgjCo)  "  g2<°)»  0)|  +  /  |z1(o)  -  z2(o) |  do 

a  **  a  ** 

-  I^l  ~  S2|2(v  +  ^  +  lgl  "  g2 1 2  +  +  1)IZ1(<J)  "  z2^a^n  do* 

tk  • 


..n  . 


Gronvall's  Inequality  may  be  used  to  obtain 


|«1<0  ~  z2(t)lq  -  (l?l  -  ^2|2(V  +  1}  +  igl  '  82|2)* 

b 

exp  f  ( 2u(o )  +  l)do 

a 

from  which  continuous  dependence  (uniform  in  t  t  [a,  b])  follows  at  once.  ^ 

We  have  demonstrated  the  equivalence  between  an  FDE  in  x(t)  c  Rn  and  an 
abstract  evolution  equation  (AEE)  in  the  infinite-dimensional  state  variable 
z(t).  We  remark  that  the  infinite  dimensionality  of  (2.6)  is  inherited  from 
(2.1)  in  that  in  the  latter  the  history  of  x  on  [t  -  r  ,  t)  is  required  before 
x  may  be  determined  at  t.  Thus  the  computational  difficulties  encountered  with 
(2.6)  are  not  simply  an  undesirable  feature  of  this  reformulation  of  (2.1)  but 
rather  are  a  manifestation  of  the  inherent  infinite  dimensionality  of  the 
underlying  FDE. 

In  view  of  the  established  equivalence,  the  ID  problem  In  (2.3)  may  be 
reformulated  as  an  abstract  ID  problem,  where  we  now  wish  to  find  y  e  T  which 
minimizes 

1  M  ~  o 

(2.8)  J(y)  -  2  l  |C(q)wQ*(ti ;  y)  -  uj 

over  all  y  e  T  where  rr^  :  z  -*■  Rn  is  defined  by  itq(5,  <J<)  ■  £• 

In  the  next  section  we  investigate  the  problem  of  approximating  the  infinite 
dimensional  identification  problem  (2.8)  by  a  sequence  of  finite-dimensional 
state  space  identification  problems  (where  the  state  variable  satisfies  an 
ordinary  differential  equation  (ODE)  on  a  finite-dimensional  state  space  X^). 
Fundamental  to  this  undertaking  is  the  establishment  of  the  convergence  of 


14 


N 

solutions  of  the  approximating  systems  on  X  to  solutions  of  the  original 

equation  on  Z.  Although  our  formulation  Is  a  classical  one  of  the  Ritz  type 

(involving  orthogonal  projections  of  an  infinite-dimensional  system  onto  a 

sequence  of  finite-dimensional  subspaces)  our  problem  is  complicated  by  the 

fact  that  the  state  space  changes  for  each  choice  of  parameters  q  »  (a,  r ^ ,  .... 

r  ) .  This  concept  is  explained  in  detail  in  [4,  p.  800]  and  involves  the  idea 

that  the  natural  state  space  for  z(t)  associated  with  the  parameter  choice 

q  *  (a,  r^  ....  rv>  is  X(q)  ■=  Rn  *  L^-  r^,  0),  where  in  general  X(q)  ^  Z. 

Since  we  would  expect  the  (finite-dimensional)  approximating  spaces  XN(q) 

associated  with  q  to  be  subspaces  of  X(q),  we  obtain  a  sequence  of  spaces  (XN(q)} 
N 

where  X  (q)  is  different  for  each  choice  of  q  and  is  usually  not  contained  in  7. 


§3  Approximate  parameter  estimation  problem 


Our  focus  in  this  section  is  the  definition  of  finite-dimensional  ODE- 
governed  estimation  problems  which  approximate  the  ID  problem  governed  by  the 
AEE  (2.6),  and  their  relationship  to  the  original  FDE-based  ID  problem.  While 
we  shall  present  the  details  for  a  scheme  based  on  linear  splines,  arbitrary 
order  spline  approximations  may  be  employed  in  a  similar  way  with  only  slight 
modifications  in  the  arguments  detailed  below  (see  the  theory  developed  in  [6] 
on  which  all  of  our  development  here  is  based). 

For  parameters  y  »  (c,  q)  e  T  consider 

(3.1)  zN(t;  Y)  -  PN(q)C  +  /  (AN(q,  a)zN(o;  y)  +  PN(q)G(a) }da ,  t  e  [a,  b], 

a 


where  AN  and  PN 
For  a  given  q  • 


are  defined  via  the  following  q-dependent  operators  and  spaces. 

(a,  r. ,  . ..,  r  )  we  define  the  Hilbert  space  X(q)  as  the  set 
V  ° 

0)  with  inner  product  <(£,  \J») ,  (6,  x)>  ■  M  +  f  'J'(0)x(°)p (9)  (O)d0, 

p»s  _r 


v 
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\,  % 

where  p(q)(0)  *  p(q)(0)  -  1,  with  p  defined  as  in  (2.5).  We  shall  also  use  an 

equivalent  topology  on  X(q)  given  by  the  (unweighted)  inner  product 

<(£,  4<) »  (<5,  xJ'v  „  *  ST|$  +  /  4/(0)x(0)dQ-  The  operator  C+(q) :  X(q)  ►  Z  is 

» q  _ 

v 

the  "continuous  extension"  operator  defined  by  C  (q)(£,  40  =  (£,  40  where 
4>  ®  <p  on  [-  r^,  0],  ^(Q)  =  iK~  r^),  0  c  [-  r  ,  -  rv);  i(q)  :  Z  -*■  X(q)  is  defined 

by  i(q)(£,  40  *  (£,  ip)  where  ip  is  the  restriction  of  4<  to  [-  r^,  0].  The  sub¬ 
spaces  XN(q)  of  X(q)  are  defined  by  XN(q)  =  {(4*(0),  ip)  |  \p  is  a  piecewise  linear 
spline  with  knots  at  t^(q)  ■  [-(j  -  (k-l)NXrk  -  ~  rk  i* 

j  *  (k  -  1)N  +1,  kN,  k  =  1,  . ...  v;  t^  *  0}  and  we  denote  by 

irN(q)  :  X(q)  -*  X^q)  the  canonical  orthogonal  projection  of  X(q)  onto  XN(q) 
along  XN(q)'L.  Finally,  p\q)  :  Z  -*•  X^(q)  is  defined  by  PN(q)  »  irN(q)i(q)  and 
AN(q,  a)  :  X(q)  ■*  XN(q)  is  given  by  AN(q,  o)  =  TTN(q)A(q,  o)irN(q)  where  here 
A(q,  o)  is  interpreted  as  an  operator  on  X(q)  given  by  A(q,  a)  (4^(0) ,  4>q)  * 

(F (q ,  a,  H»q(0),  4^),  04^)  for  (<pq(0),  4>q)  e  X(q)  (with  <|/q  the  extension  of  ^ 

to  all  of  [-  r,  0]  defined  by  ^  5  0  outside  of  [-  r^,  0]). 

N  N  N 

Remark  3.1  A  is  well-defined  since  X  (q) ,  the  range  of  n  (q),  is  contained 

N 

in  the  domain  of  A(q,  t) .  Note  also  that  A  (q,  t)  actually  may  be  considered 

N  N  N  N 

as  an  operator  from  Z  into  X  (q)  if  it  is  defined  by  A  (q,  o)  -  P  (q)A(q,  o)P  (q). 

For  present  uses  though,  PN(q)c  and  zN(o,  y)  are  in  X^(q)  so  that  viewing 

A**(q,  a)  as  an  operator  from  X^(q)  to  itself  yields  (3.1)  as  an  equation  on 

XN(q) ,  a  finite-dimensional  space  since  each  of  its  elements  is  completely 

determined  by  it9  value  at  each  of  vN  +  1  knots.  Equation  (3.1)  is  then 

equivalent  to  the  ODE 
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(3.2) 


zN(t;  y)  “  AN(q,  t)zN(t;  y)  +  PN(q)G(t),  t  e  (a,  b] 


N,  ,  _N.  . 

{  z  (a;  y)  =  P  (qK, 

which,  as  we  shall  show  In  the  arguments  that  follow,  approximates  (2.1)  in 
some  sense. 


When  the  parameter  y  Is  unknown  we  may  state  an  "approximate  identification 

problem"  P„  associated  with  (3.1)  and  (3.2): 

N 

—ft  _ N  —ft 

Find  Y  =■  (5  ,  q  )  e  T  so  as  to  minimize 
M 

JN(y)  “4  l  |c(q)7r  zN(t;  y)  -  u  |2 
z  i-1  u  1 

over  y  £  P»  where  g  and  observations  u^  at  times  t^,  i  *»  1,  . ..,  M  are 
N 

given  and  z  (t;  y)  satisfies  (3.1). 

We  now  establish  the  existence  of  a  unique  solution  to  (3.1)  for  each 

choice  of  y,  and,  further,  the  existence  of  a  solution  y  to  the  NL  ID  problem, 

P  ...  First  we  must  state  an  analog  of  Lemma  2.2  which  demonstrates  a  type  of 
N 

dissipativeness  for  AN. 


Lemma  3.1.  Let  q  *  (a,  r^,  ry)  e  Q  be  given.  Then 


<AN(q,  t)yN  -  AN(q,  t)zN,  yN  -  zN> 


p.q 


<  »<t)  |yN  -  z\2>q 


for  all  yN,  zN  e  X**(q)  where  u>,  defined  in  Lemma  2.2,  is  independent  of  q  and  N. 


m 
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Proof :  Note  first  that  for  y,  z  e  W(q)  *  ((iKO),  \/»)  |  \p  e  H  (-  r^,  0)}  we  may 

argue  that 


<A(q,  t)y  -  A(q,  t)z,  y  -  z>  £  w(t)  y  -  z 

P »q  p  ,q 


using  estimates  similar  to  those  used  to  prove  Lemma  2.2,  where  w(t)  is 
Independent  of  q,  N.  Then  for  yN,  1  c  /(q)  C  W(q) , 


aN,  _  N  N  N  N  N 

<A  (q,  t)y  -  A  (q,  t)z  ,  y  -  z  > 


N/  x./  .  N.  .  N  N,  x » /  x  N,  .  N  N  N 

<ir  (q)A(q,  t)ir  (q)y  -  it  (q)A(q,  t)ir  (q)z  ,  y  -  z  > 


w  x  N/  x  N  ..  .  N,  n  N  N,  .  N  N.  .  N 

<A(q,  t) tt  (q)y  -  A(q,  t)ir  (q)z  ,  it  (q)y  -  it  (q)z  > 


/  X  I  N.  x  N  N,  x  N,2 
_<  u(t)  |  tt  (q)y  -  tt  (q)z  |p  ^ 


.  x  |  N  N  i  2 
<  «<t)|y  -  z  jp>q 


where  we  have  used  the  properties  of  the  (self-adjoint)  orthogonal  projection 
irN  and  the  dissipativeness  of  A(q,  t)  on  W(q) . 


Our  next  result  demonstrates  the  existence  of  solutions  to  (3.1)  as  well 
as  to  the  identification  problem  P^.  In  addition,  the  proof  sheds  light  on 
the  numerical  procedure  used  to  solve  (3.1). 

Theorem  3.1  Let  g  e  L^a,  b)  and  y  =  (C,  q)  c  r  be  given.  Then  there  exists 
a  unique  solution  zN(t;  y,  g)  e  X^(q)  to  (3.1)  on  [a,  b]  with  the  property  that 
the  map  {i(q)C,  g)  -*•  zN(t;  (C,  q) ,  g)  is  uniformly  continuous  on  X(q)  x  L^a,  b), 
uniformly  in  N  and  t.  Finally,  there  exists  a  solution  y^  to  the  h’11'1 
identification  problem  PN  for  each  N  *  1,  2,  ...  . 
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Re nark  3.2:  The  continuity  with  respect  to  initial  data  given  in  this  theorem 

is  actually  "uniform  in  q  e  Q"  in  the  following  sense:  Given  e  >  0,  there  exists 
6  >  6  Independent  of  q  and  N  such  that  for  ^  e  S  and  q  e  Q  with 
|  Cx  ~  C2(x  <  5,  we  have  |zN(t;  q) ,  g)  -  zN(t;  (s2>  q) » g)  |  x  <  e.  This 

type  of  "uniformity  in  q"  follows  from  the  arguments  given  below  for  Theorem  3.1 
and  will  be  used  in  establishing  the  convergence  results  of  Theorem  3.3. 

Proof:  We  first  argue  existence,  uniqueness  and  continuous  dependence  of 

solutions  to  (3.1).  We  shall  do  this  using  arguments  similar  to  those  in  [l]  and 

[6]  (where  zN(t)  is  written  in  terms  of  basis  vectors  for  X**(q)).  q  e  Q  be 

N 

fixed,  q  *  (a,  r^,  ...,  r^) ,  and  let  e^  denote  the  scalar  first-order  spline 
function  on  [-  ry,  0]  characterized  by 

•?  (t"i> "  •  *> J '  °’ 1 . 

N  N 

where  <5^  is  the  Kronecker  symbol  and  t^  =  t^q)  are  the  knots  defined  for 
N 

functions  in  X  (q) ,  i  “  0,  ...,  vN.  Define 

ej  -  (ej(0),  e^ ) ,  j  -  0,  ....  vN,  and 

BN  -  (e^,  ...,  e^)®I,  where 

I  is  the  n  x  n  identity  matrix  and  ®  denotes  the  Kronecker  product  so  that 
8^  is  an  (n  *n(vN  +1))  -matrix- valued  function  on  [-  r^,  0],  Represent  by 
8  Che  matrix-valued  pair, 

8n  -  (eN(o),  eN). 

Prom  [6],  XN(q)  ■  span  {8j},  j  ■  1,  ....  n(vN  +  1)  where  the  basis  vectors 
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are  given  by  8j  ■  (8^(0),  8  ^ ) ,  Bj  the  jtl1  column  of  8N.  It  follows  then  that 
since  zN(t)  €  XN(q) ,  there  exists  wN(t)  e  Rn^vN  +  such  that 


N.  v 
z  (t) 


8NvN(t) 


vN 

c  N  , . .  N 
Z  w4  <*>e. 
j”0  3  3 


(w"(t),  T  w^(t)e^) 

u  j»0  3  3 


for  w^(t)  e  Rn,  j  *  0,  vN.  Furthermore,  since  PNG(t)  and  PN£  are 

vectors  in  X^q) ,  there  exist  GN(t),  £N  e  Rn^vN  +  ^  such  that 


PNG(t)  -  6NGN(t) 


pn?  -  SV 


so  that  equation  (3.2)  may  now  be  written  in  terms  of  8  as 


(3.3) 


fiNwN(t)  -  AN(q,  t)8NwN(t)  +  8NGN(t),  t  e  (a,  b] 


:n  N.  .  :n  N 
8  w  (a)  =  6  £  . 


Let  AN(q,  t)  denote  the  representation  of  AN(q,  t)  (restricted  to  XN(q))  with 

respect  to  the  basis  of  XN(q).  Here  AN(q,  t)  is  nonlinear  as  opposed  to  the 

matrix  (linear)  version  of  the  operator  arising  in  [6].  As  in  [l]  and  [6],  usual 

N 

Galerkln  calculations  establish  that  the  coefficients  w  (t)  in  (3.3)  satisfy 


(3.4) 


wN(t)  *  AN(q,  t)wN(t)  +  GN(t)  ,  t  e  (a,  b] 


N.  \  N 

v  (a)  *  r.  . 
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N 

We  next  establish  a  representation  of  A  (q,  t)  which  will  enable  us  to  consider 
the  existence  and  uniqueness  of  solutions  to  (3.4)  as  well  as  the  realization  of 
numerical  solution  techniques  for  the  system.  Note  first  that 

vN 

.N.  N.  .  N.  ...  _\  N.  w  N.  .  r  N,_  N. 

A  (q,  t)  z  (t)  =■  it  (q)A(q,  t)ir  (q)(w  (t),  \  w  (t)e  ) 

j  =  0  .  J  3 


where  ^  :  A  x  [0,r]  x  R1+n^vN  +  ^  ->  Rn  is  defined  by 


£(c 


",  (v0, 


T 

V\»N  )  = 


for  Vj  e  R  ,  j 

(V0’  VvN)T 

-^(q,  t)wN(t)  - 


»  0,  ....  vN,  and  can  be  shown  to  be  globally  Lipschitz  in 
e  r°^vN  +  ^  since  f  satisfies  such  a  condition.  Thus, 
a  (t),  where  a  (t)  £  R  is  such  that 


:n  N.  . 

S  a  (t) 


AN(q.  t)eV(t) 

irN(q)/?(a,  r^,  t,  wN(t)), 


vN 

l 


j-0 


w^  (t)Pe 
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It  follows  from  [6,  p.  508]  that  whenever  ir^(q)(£,  >p) 


6N6N,  (C,  H>)  e  X(q) , 


,N  Dn(vN  +1)  , 

o  e  R  ,  we  have 


N  -1  N 

(Q  )  hN(C,  *) 


where  the  nonsingular  matrix  QN  is  given  by  QN  =  (6^(0)) ^gN(0)  + 

/  eN(O)V(e)0(q)(©)dO  and  hN(C,  *)  =  (SN(0))TC  +  f  BN(0)T^(0)p(q)  (0)d0. 


-r 


-r 


We  may  apply  these  results  to  obtain 


vN 


N.  .  _N.-1  ,Na,  N,  ..  r  N ,  N. 

a  (t)  =  (Q  )  h  (f(a,  r  ,  t,  w  (t)),  J  w  (t)Pe  ) 

j=0  J  2 


N  -1  /^a’  r\,*  c»  w  N  -1  N  N 

-  (QN)  1  I  v  n  \  +  (Q >  hJ2  w  (t) 


where  H^2  is  given  in  [6]  and  [lO]  by 


12 


•  N  N 

<eo’  V 


•  N  N 
<e  *6  > 

O’  vN 


•N  N 
<evN’  e0> 


•N  N 
<evN’  evN>' 


®  I. 


In  this  matrix  <•,  •>  denotes  the  o (q)-weighted  L2(-  r^,  0)  inner  product. 

Similarly,  GN(t)  in  (3.4)  is  given  by  GN(t)  =  (QN)  *hN(G(t)), 
hN((g(t),  0))  *  (g(t),  0,  ...,  0)T  e  Rn^VN  +  1) »  go  (3.4)  may  be  rewritten 


as 


(3.5) 


fwN(t)  =  (QN)  1  (^(a,  r  ,  t,  wN(t))  +  g(t),  0  . . . ,  0) 


+  (qV1  H^2wN(t)  ,  t  c  (a,  b] 


1  N.  .  N 
K.v  (a)  **  z,  , 


an  ODE  in  wN(t)  *  wN(t;  y,  g)  e  Rn<-vN  +  Since  f  satisfies  a  global  Lipschitz 

N 

condition  in  w  (t) ,  the  form  of  (3.5)  allows  one  to  employ  standard  ODE  theory  to 

•btain  the  existence  of  a  unique  solution  wN(.t)  on  [a,b].  We  can  therefore  conclude 
that 


z  (t) 


3NwN(t) 


is  the  unique  solution  to  (3.1)  (and  (3.2))  on  [a,  b]  for  C  £  Z  given. 

The  proof  of  the  continuous  dependence  on  C  and  g  as  stated  in  the  theorem 
is  identical  to  the  corresponding  proof  in  Theorem  2.2  where  dissipativeness 

<  6  and 

,q 

Jgl  -  g2 !  <  <5 ,  5  =  <5  (£  a  *  b)  independent  of  t,  q,  and  N,  we  have  for  the 

N  N 

corresponding  solutions,  z^t;  q)  ,  g^)  and  z2(t;  U2>  q) ,  g2)  , 


for  A*  (q,  t)  is  now  used  to  show  that  whenever  |  s  -  z. 


2 1  X 


N 


< 


(t)  -  z 2 ( t ) |x^ 
l  N,  .  N  i 

lZl(t)  -  Z2(t)l0, 


<  e 


for  all  t  e  [a,  b]. 


-N 


Finally,  to  establish  existence  of  a  solution  y  to  one  argues  continuity 

N  N 

(for  fixed  N)  of  the  map  y  =  (£,  q)  tt^z  (t;  y)  =  w^(t,  y)  and  thus  infers 
N 

continuity  of  y  -*■  J  (y)  on  the  compact  set  F.  But  it  is  not  difficult  to  see 


that  the  right  side  of  (3.5)  depends  continuously  on  q  as  do  the  basis  elements 
*N 

e^  (q) .  Continuous  dependence  results  (with  respect  to  parameters  and  initial 
data)  from  the  theory  of  ordinary  differential  equations  can  then  be  invoked 


to  obtain  the  desired  conclusions. 
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— N  th 

In  view  of  the  last  result,  we  are  assured  of  a  solution  y  to  the  N 

estimation  problem  P.  (which  is  a  standard  least  squares  problem  governed  by 

N 

an  ODE).  Since  an  application  of  conventional  optimization  techniques  requires 

a  solution  to  (3.1)  for  each  choice  of  y,  straightforward  computational  schemes 

may  be  devised  to  solve  (3.5),  the  associated  ODE  in  the  "Fourier"  coefficients 
N 

w  (t).  Although  it  may  be  relatively  easy  to  solve  the  finite-dimensional 
problem  P  ,  the  solution  y^  we  find  is  meaningful  only  if  yN  approximates  the 

solution  y  to  the  original  ID  problem.  Fundamental  to  the  establishment  of 

— N  — 

this  fact  (i.e. ,  the  convergence  of  y  to  y  in  some  sense)  is  the  demonstration 

N  N  'v 

that  the  sequence  of  state  variables  (z  ( t ;  y  ,  g) }  converges  to  z(t;  y,  g)  given 
any  sequence  {y^}  with  y^  ->  y  =  (£,  q)  in  r.  We  shall  first  consider  this 
problem  for  limits  y  and  perturbing  functions  g  such  that  {£,  g)  lies  in  a  smooth 
but  dense  subset  of  W  *  (a,  b)  (which  simplifies  our  calculations).  We 

'V 

then  extend  the  convergence  results  for  all  limits  t,  and  perturbations  g  such 
that  (i,  g }  e  W  *  L^a,  b) . 


§3.1  Convergence  of  state  variables 

N 

We  shall  assume  that  a  sequence  of  parameters  {y  }  in  r  has  been  given, 

N  ,  N  N.  ,  N  AN  N  N  Nn  .  _  N  ^ 

y  =  (C  ,  q  )  =  (n  ,  <t>  ,  a  ,  rx,  ....  ry) ,  and  that  y  •+  y  =  (£,  q)  = 

x  x  x  x  x  n  ^  y*t*v 

(n,  <fr,  a,  r^,  r^)f  in  the  sense  that  (i)  q  q  in  R  and  (ii) 

i  N  ^  N  i 

ji(q  )(£  -  C  )  I  qN  -*■  0  as  N  -v  ®.  We  make  the  following  standing  assumptions 

% 

on  y  and  S: 


(H6) 


■  'll  'Y,  , 

There  exists  some  6  >0  such  that  r.  -  r,  ,  >  5  ,  k  ■  1,  2, 

r  1  k  k-1 1  —  r 


(H7)  If  £  e  S  then  C+ (qN)i(qN)c  e  S  for  all  N. 


24 


Remark  3.3:  We  note  that  the  set  S  Involving  all  polynomials  of  order  <  k  on 

[-  r,  0]  mentioned  in  Remark  2.3  does  not,  strictly  speaking,  satisfy  (H7). 
However,  the  reader  can  easily  see  from  the  arguments  below  that  a  modification 
in  defining  the  extension  operator  C+  (rather  than  extend  from  [-  r  ,  0]  to 
[-  r,  0]  by  constant  values,  extend  any  polynomial  on  [-  r^,  0]  to  [-  r,  0] 
by  simply  extending  the  domain  of  definition  of  the  polynomial)  would  allow  the 
set  S  of  Remark  2.3  to  satisfy  (H7)  and  not  require  any  change  in  the  convergence 
arguments  to  follow. 

In  what  follows  we  will  simplify  notation  by  abbreviating  /  E  XV). 

AN(t)  E  AN(qN,  t),  A(t)  E  A(q ,  t),  PN  E  PN(qN) ,  iN  E  i(qN),  "N  =  TrN(qN), 


(£  E  C+(qN),  and 


We  shall  also  use  | • |N  to  denote  the 


l”(-  r^,  Oj  norm  weighted  with  p(qN).  We  remind  the  reader  that  |*|  denotes 

either  the  Z  or  L^-  r*  nor®  while  |*|  N  denotes  the  unweighted  L^C-  0) 

rv  ,  %  % 

norm.  When  no  confusion  results  we  shall  also  write  z(t)  instead  of  z(t;  y,  g) 

and  zN(t)  for  zN(t;  yN,  g) ,  the  solutions  to  (2.6)  and  (3.1)  associated  with  y 
and  yN,  respectively. 

For  q  given  in  Q,  define  7(q)  *  {{5,  g)  e  W  *  L^a,  b)  |  £  »  (ip(0),  ip) , 

>l>  e  H2(-r,  0),  g  e  H1(a,  b) ,  *(0)  =  F(q,  a,  ^(0),  ip)  +  g(a)|  and  define 

S  *■  {(ip(0),  ip)  e  Z\ip  e  H2(-  r,  0)}. 

Lemma  3.2.  For  any  q  t  Q,  I(q)  is  dense  in  W  *  L^a,  b)  (in  the  Z  *  L^a,  b) 

topology).  Furthermore,  if  {5,  g}  e  I(q),  then  the  solution  z(t;(C,q),g)  * 
(x(t;(C,q),g),xt((c,q),g))  to  (2.6)  corresponding  to  C*  q,  g.  satisfies 
z(t)  e  S  for  all  t  c  [a,  bj. 
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Proof:  Let  q  e  Q  and  c  =  (4/(0),  4>)  be  fixed  in  S  and  define  I  (q,  c)  * 

{g  .  L^a,  b)  | g  c  H1(a,  b) ,  g(a)  -  4>(0)  -  F(q,  a,  4/(0),  4<)  >•  Then  for  g 
e  L”(a,  b)  given  and  c  0,  standard  arguments  may  be  used  to  construct  a  g 
that  is  piecewise -C^1  ^  satisfying  g(a)  =  4/(0)  -  F(q,  a,  4/(0) ,  4/)  with 
|g  -  gj  <  e.  That  is,  I(q,  O  is  dense  in  L^a,  b).  Furthermore,  for  '  t  S, 
the  pair  {£,  g)  belongs  to  I(q)  whenever  g  e  I(q,  r.) ,  so  that 

tysCU}  x  I(q,  C)]C  I(q)  C.  W  x  L"(a,  b) 

where  the  first  set  is  dense  in  the  last  since  S  is  dense  in  W.  It  follows 
that  I(q)  is  dense  in  W  x  L^(a,  b) . 

Required  for  the  proof  of  the  second  part  of  the  theorem  is  a  verification 
that  x  e  L2(a  -  r,  b)  (since  P2^)  =»  (x)t  for  t  e  [a,  b]) .  If  (c,,  g}  c  I(q), 

C  *  (h,  $),  it  follows  that  x  e  C^La~r,b]  since:  (i)  x(t)  =  4> ( t  —  « )  for 
t  e  [a  -  r,  a);  (2)  for  t  e  (a,  b) ,  x(t)  <*  f(a,  r^,  t,  x(t),  xt»  xft  -  r^,  .... 
x(t  -  r^))  +  g(t),  which  is  continuous  from  assumption  (H2)  and  the  definition 
of  TCq)  ;  and  (3)  x(a  )  *  $(0)  »  F(q,  a,  4>(0),  <f>)  +  g(a)  *  x(a+).  Further,  the 
differentiability  of  f  and  g  yields 

x(t)  *  fo(a,  ry,  t,  x(t),  xt,  ...)  +  f ^ (a ,  ry,  t,  x(t),  xt,  ...)  x(t) 

+  V  V  *t3 

v 

+  I  fv  (a»  r„»  r*  x<Ot  *-*)x(t  -  r  )  +  g(t) 
i=l  yi  V  1 

for  t  e  (a,  b) ,  where  f^  denotes  the  Frechet  derivative  of  f(a,  r^,  a,  f,,  4/, 
y^,  ....  y^)  with  respect  to  6,  6  -  a,  £,  ...»  yv*  The  global  Lipschitz 
condition  on  f  ensures  that  these  derivatives  (excluding  f  )  are  bounded,  so 


26 


Chat,  for  almost  all  t  £  (a,  b) , 

|f^(a,  r  ,  t,  x(t),  xt,  ...)x(t)|  <  m^t) |x(t) | , 

r^,  t,  x(t) ,  xt,  •  •  • »  |  ( t )  |  x^  | , 

and  similarly  for  f  .  Therefore, 

| x(t) I  <  |f  (a,  r  ,  t,  x(t),  x  ,  ...)|  +  cm. (t)  +  |g(t) | 

'  —  o  v  c 

•  ^ 

almost  everywhere  on  (a,  b) ,  where  m  ,  g  e  I^Ca,  b) ,  and  c  is  a  constant. 
Using  (M3)  we  thus  obtain  that  x  e  L^(a,b)  and  it  hence  follows  that 
x  e  L^(a  -  r,  b)  since  x(t)  =  <J>(t  -  a) ,  t  e  (a  -  r ,  a)  ,  <j>  e  L^(-  r,  0). 


Essential  to  our  convergence  proofs  are  certain  standard  estimates  from 
the  theory  of  spline  approximations,  in  particular  the  Schmidt  inequality  and 
Theorem  2.5  from  [16].  The  inequalities  are  stated  in  the  next  lemma. 
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I fc 
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These  estimates  may  now  be  employed  to  show  convergence  of  z  (t;  y  ,  g)  to 
z(t;  >,  g)  (in  the  proper  sense)  when  z(t)  e  S;  i.e.,  when  (C,  g)  e  ^ ( q)  • 

N  N  ^  N  N  N 

Theorem  3.2.  Let  [y  }  be  arbitrary  in  r  with  y  -*•  y,  y  =  (C  ,  q  ). 

y  *  (c,  q)  e  T,  where  fc,  g)  e  I (q) ,  and  let  zN(t;  yN,  g) ,  z(t;  y,  g)  denote 

the  solutions  to  (3.1)  and  (2.6)  associated  with  y  and  y  respectively.  Then 

!zN(t;  /,  g)  -  PNz(t;  y.  g)lN  •*  0 

as  N  +  «■  uniformly  in  t  e  [a,  b]. 

Proof:  We  have  AN(t)  _r  zN(t)  _  pNz(t) 

-  PN^N  +  /  (AN(o)z^(o)  +  PNfi(o)}do 

* 

-  P N ^  -  /  (PNA(o)z(o)  +  PNG(o)}do 

a 

■  AN(a)  +  /  (AN(o)zN(o)  -  PNA(a) z(o) }da 

a 

so  that  from  Lemma  2.1  we  obtain 

UVjljj-  |AN(a)|* 

+  2  /  <AN(o)zN(o)  -  AN(o)PNz(o),  AN(o)>Ndo 

a 

+2  /  <A^(o)P^z(o)  -  P^A(o)z(o),  AN(o)>^do 


if r  isfaftBnTf  r  i 
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<  |AN(a)|^  +  2  /  co(a)|AN(a)i^do 


+  2  /  !AN(a)PNz(a)  -  PNA(a)z(o) |N| AN(o) |Ndo 


i  ! AN(a) | ^  +  J  (2u(o)  +  l)|AN(a)|^do 


+  /  |AN(a)PNz(a)  -  PNA(a) z(o) | ^do . 


Gronwall's  inequality  may  be  employed  (since  the  function  2w  +  1  is  positive  and 
AN  is  continuous  in  t)  to  obtain 


AN(t)|^£  Ce^CN)  +  c 2 (N ) )  exp  /  (2u(o)  +  l)do 


where 


ex(N)  «  I  AN(a)  |  2 


D 

e2(N)  *  /  |AN(o)PNz(o)  -  PNA(o) z(o) |^do. 


It  remains  to  show  that  e^(N)  +  0  as  N  +  that  the  convergence  is  uniform 
in  t  is  readily  seen.  First, 


«l(N)  -  iAn-pn^ini  |AN-  Ain 

N  x 

converges  to  0  as  N  -*•  »  from  the  definition  of  convergence  of  y  to  y.  We 
will  also  obtain  e2(N)  ■+  0  once  we  demonstrate  the  dominated  convergence  of 


|AN(o)PNz(o)  -  PNA(o)z(o)  -  0. 
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Let  z(o)  =  (yo(0),  yo),  PNz(a)  »  (y0(O),  y0) ,  y^  e  L^C-  r^,  0).  Then 
|AN(o)PNz(o)  -  PNA(a)z(a)|2 

=  I TtNA(qN ,  o)ttNPNz(o)  -  TTNiNA(q,  a)z(o)(2 

=  |iTN(F(qN,  a,  y^(0),  y*S ,  VS 

a  a  a 

-  TrN(F(q,  a,  y0(O),  y0),  Vy^)  |2 

1  )F(qN,  a,  y0 (O)»y0)  -  F(q,  a,  yff(0),  yff) | 2 

+  i^-p^In 

2  tJ(o)  +  t”(o), 

N 

where  yQ  must  be  extended  to  all  of  [-  r,  0]  (by  defining  it  to  be  zero  off 
[-  r^,  0])  before  F  is  evaluated  at  y^.  From  (3.7),  T^cj)  ■+  0  as  N  +  », 
Furthermore, 

(T^(o))1/2  <  [F(qN,  0,  yjj(0),  yJJ)  -  F(qN,  o,  yo(0),  yg) I 

+  I F(qN,  o,  yo(0),  yo)  -  F(q ,  a,  y0(O),  y^) | 

-  N.  .  .  N.  . 

=  t1(o)  +  r  2 (o) 

where  -^(a)  +  0  aa  N  +  »  since  quite  standard  arguments  (recall  (HA))  may  be 
used  to  show  that  the  map 


fa 
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q  -  (a,  rL,  ....  r  )  F(q,  a,  <K0) ,  \j>) 

»  f  (a,  r^,  a,  i 1/(0),  1 1>,  i p(-  r^,  ....  \p(-  O) 

N  1 

is  continuous  whenever  \p  is  continuous.  In  addition,  x^(o)  is  0(— )  (for  almost 
all  o)  from  (3.6),  (3.8)  since,  for  almost  all  a, 

|F(qNt  a,  y0(O),  y0)  -  F(qN,  o,  yo(0),  yQ) | 

<  m1(o){|yN(0)-yo(0)i  +  |y0  ~  yolN  +  ly”(-  rj)  -  y0(- 

and  |y^  -  y0lN  ±  |PNz(o)  -  2(0)!^.  Therefore,  for  almost  all  a  e  [a,  b], 

T^(o)  +  0  as  N  +  «,  and  the  convergence  (a.e.)  to  zero  of  the  integrand  of 
e^(N)  is  assured.  Dominated  convergence  follows  from  similar  arguments: 

|AN(o)PNz(a)  -  PNA(o)2(o)|^ 

N 


,  N.  .  ^  N.  ..2  .  N.  . 
1  (t1(o)  +  t2(o))  +  T2(o) 


as  before  where,  from  (3.7),  T2(o)  <  k2|  P2yo | 2  ^  k2*^  < 


%  ■  •  «[3]  i  .  /  ly<0> 1 2d0  -  M*  b). 


(we  have  made  use  of  Lemma  3.2  to  assert  that  s(o)  e  S  for  all  o;  i.e., 

9 

y  e  H  (a  -  r,  b)).  The  Lipschitz  condition  on  f  and  estimates  (3.6),  (3.8) 
may  be  used  to  show 


t1(o)  <_  cmj (°)Mq 


for  a  constant  c  >  0  and  almost  all  o.  Finally, 
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T2(o>  -  |F(qN,  o,  y (a) ,  y0)  -  F(q,  o,  y(o),  yo)  | 

1  2  sup  |F(q,  a,  y (a) ,  y  ) | 

(q,o)  eQx[a,b] 

where  y  was  determined  by  a  fixed  q  e  Q  and  is  thus  independent  of  q  and  is 
continuous.  Again  the  continuity  of  F(q,  o,  y(a) ,  y  )  in  (q,  a)  may  be  easily 
established,  (q,  a)  in  the  compact  set  Q  *  [a,  b],  so  that  there  is  some 

*  *  r  -y 

(q  ,  o  )  in  Q  *  [a,  b]  such  that 

^(o)  <  2  |  F(q*,  a*,  y(o*) ,  ya*)  | 

=  <  <*>. 

It  follows  then  that,  for  almost  all  a  e  [a,  b], 

|AN(a)PNz(o)  -  PNA(o)z(o)|^ 

<  (cm^ajMg  +  Mx)2  k^MQ  =  h(a) 

where  h  e  L^a,  b)  (since  e  L2<a,  b)).  The  theorem  thus  obtains. 

IZI 

We  now  turn  to  the  main  state  variable  convergence  result  for  arbitrary 

%  R 

(£»  g)  e  W  x  L^Ca,  b) ;  it  contains  the  key  arguments  needed  to  prove  Theorem  3.4 
below  which  describes  how  solutions  yN  (to  P  )  converge  to  y,  a  solution  to  the 
original  parameter  estimation  problem. 

Theorem  3.3.  Suppose  yN  y  where  yN  -  (5N,  q^)  and  y  m  (x,  q)  are  arbitrary 
in  T.  Then  for  any  g  c  L^U,  b) , 


*!-*■«  ti  ■  . 
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N,  N  .  -v 

"Qz  (t;  Y  i  g)  -*■  ir0z(t;  y,  g) 

as  N  -*  «  uniformly  in  t  e  [a,  b]. 

Proof : 

lvN(t;  yN’  g)  -  v(t;  '*'*  s)  i 

.  N,  N  s  J  .  1.  .  I 

£  l*0z  <c;  Y  .  g)  -  ^qP  z(t;  Y,  g)  ! 

+  |  TTQPNz  (t ;  Y>  g)  -  "Qz(t;  y,  g)  I 

5  T^(t)  +  T^t) 

where  T^(t)  -*■  0  as  N  ->  °°  uniformly  in  t  e  [a,  b]  from  the  convergence 

tTqPNz  -*•  tt^z,  z  e  Z,  demonstrated  in  [4,  p.  814].  (Uniformity  here  is  due  to 

the  fact  that  z  e  {z(t;  y.  g) | t  e  [a,  b]},  a  compact  set  in  Z) .  Further,  since 

I(q)  is  dense  in  W  «  L^Ca,  b) ,  a  pair  {4,  g}  may  be  chosen  in  I (q)  arbitrarily 

close  to  {4,  g}  so  that,  given  that 

T^(t)  <_  |zN(t;  (4N,  qN),  g)  -  PNz(t;  (4,  q) ,  g)  |N 

_  I  N .  ,  N  N.  .  N,  ,r*  ,N~  N. 

1  I z  (t;  (4  ,  q  ),  g)  -  z  (t;  (CN  i  4,  q  ),  g) |N 

+  |zN(t;  <C+  iN4,  qN),  g)  -  PNz(t;  (4,  q),  g) iN 

+  |PNz(t;  (4,  q),  g)  -  PNz(t;  (4,  q) ,  g)lN  . 

the  first  and  third  terms  may  be  made  as  small  as  desired  from  the  continuous 
dependence  of  zN,  z  on  {iN4,  g}  c  X(qN)  *  L^Ca,  b)  and  {4,  g}  e  Z  *  L^Ca,  h) 
respectively,  uniform  in  N  and  t  (we  may  use  this  result  for  the  first  term 
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.  l  N  -+.N",  |  ,N  N  J“  ,  ,.N  N  .N'v,  .  i.N-v  ,N',  . 

since  C^i  =  I  i  4  -  i  4lx^q  i  I1  ^  1  I1  c  ”  i  r^N  is 

N  ^ 

arbitrarily  small  from  the  convergence  of  4  to  4)  •  Finally,  the  middle  term 

goes  to  0  uniformly  in  t  e  [a,  b]  as  N  +  ®  since  {4,  g}  e  7(q)  and  the  parameters 

(C  i„4,  q  )  involved  converge  to  (5,  q)  in  the  sense  required  (|q  -  q  1  0  and 

N  N 

i ijjC  ~  ^{,/Cn^N^N  =  0) »  so  that  we  are  quaranteed  the  uniform  convergence  of 

N  N  v  .  ,  ■v 

»Qz  it;  Y  ,  g)  to  ffQz(t;  Y,  g). 


§3.2  Convergence  of  Parameters 

Our  attention  to  this  point  has  been  focused  on  the  convergence  of  solutions 
N 

z  (to  (3.1))  to  the  solution  z  (to  (2.6)),  once  the  convergence  of  any  sequence 
of  parameters  has  been  established.  In  reality,  though,  we  have  yet  to  determine 
that  any  sequence  of  solutions  (y  }  to  P„  is  in  fact  convergent;  even  then,  we 
must  prove  that  the  limiting  value  y  is  indeed  a  solution  to  the  original  param¬ 
eter  identification  problem.  The  result  we  now  state  addresses  this  question 
and  indicates  when  an  approximate  ID  problem  PN  may  be  used  to  compute  numerical 
solutions  for  the  original  problem. 

— N  — n 

Theorem  3.4.  Let  {y  },  y  e  T,  be  a  sequence  of  solutions  to  the  approximate 
parameter  estimation  problems  P  .  Then  there  exists  y  e  T  and  a  subsequence 

-Nk  _Nk  _ 

{y  }  such  that  y  -*■  y  and,  if  y  and  S  satisfy  hypotheses  (H6)  and  (H7),  y  is 
a  solution  to  the  original  parameter  identification  problem. 


+  — N 

Proof :  From  (H7) ,  the  sequence  -{ C.i.,4  }  belongs  to  S  and  S  is  compact  in  the  Z 

N  N  N 

topology,  ao  that  a  subsequence  satisfies  |CN  i_.  4  -  4  |  -*■  0  for  some  4  e  S. 

wk  Nk  N 

—  k 

The  compactness  of  Q  guarantees  the  convergence  of  a  subsequence  of  (q  }, 
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-%  -  -  -Nk  -Nk  -Nk 

q  -*•  q  for  some  q  e  Q.  Relabelling  as  y  ,  we  have  a  sequence  y  =  (C  , 


-A 


_ _ 

q  )  in  F  that  converges  to  y  =  (?,  q)  in  the  required  sense  because  q  ^  -*  q 
and 

N.  _  Wo  N, 

|iN.  C|„  1  ^  \K  C  i„  C  -  i„  C 


\  ,Nk~ 


\  Nk  \ 


Nk  X,q 


1Vl/2'C\  *  °- 
k  k 


It  remains  to  show  that  y  is  a  solution  to  the  original  ID  problem.  We  have 

(see  (2.8)  and  JN  in  the  definition  of  P  ) 

N 


J(Y>  l  I  C(q)ir_z(t . ;  y,  g)  -  u.|2 

i=l 


=  lim  J  K(y  *) 

N  ,-*•  °° 

k 


_<  lim  J  ^(y) 

N,-*- » 

k 

Nk  -^k 

where  the  continuity  of  C  and  the  convergence  of  u^z  (t;  y  ,  g)  to  TrQz(t;  y,  g) 

is  used  to  obtain  the  second  expression  and  the  final  inequality  holds  for  any 

—Nk  N, 

y  e  T  since  y  is  a  solution  to  P^  .  The  convergence  of  u^z  K(t;  y,  g)  to 

K 

itQz(t;  y,  g)  for  any  y  c  T  also  follows  from  Theorem  3.3,  so  it  follows  that 
Nk 

J  (y)  ■*  j(y)  as  ■>  =°,  or  that 
J(Y)  1  J(y) 


for  any  y  t  f.  Thus  y  is  a  solution  to  the  original  identification  problem. 
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§4  Numerical  Results 

In  this  concluding  section  we  present  a  sample  of  numerical  findings 
obtained  using  the  spline  approximation  estimation  schemes  discussed  above. 

The  test  examples  we  investigated  were  chosen  with  certain  types  of  applications 
and/or  difficulties  in  mind.  Example  4.1  deals  with  a  nonlinear  pendulum 
(small  oscillations  are  not  assumed)  with  damping  through  a  linear  feedback 
on  the  velocity.,  i.e.,  U(x)  =  kx.  We  assume  the  existence  of  accuator  delays 
in  effecting  the  feedback  laws.  (Delayed  damping  and  delayed  restoring  forces 
are  quite  common  in  mechanical  systems  —  see  Chapter  21  of  [l5].)  A  possible 
application  is  associated  with  the  design  of  a  damped  "pendulum"  to  "track"  a 
given  course  or  program  x(t).  Example  4.2  involves  a  nonlinear  nonau tonomous 
multiple  delay  equation  in  which  the  nonlinearity  is  of  the  Michaelis-Menten, 
Briggs-Haldane  velocity  approximation  type.  Such  nonlinearities  occur  in 
biological  applications  in  which  enzyme  mediated  reactions  must  be  modeled. 

Our  third  example  concerns  a  linear  multiple  delay  system  with  unknown  coef¬ 
ficients  such  as  might  arise  in  multi-compartment  transport  models,  while 
Example  4.4  contains  a  nonlinearity  that  is  only  locally  Lipschitz  and  thus 
it  does  not  satisfy  the  hypotheses  detailed  above.  It  is  interesting  (although 
not  at  all  surprising)  to  observe  that  the  methods  under  investigation  also 
perform  admirably  when  applied  to  examples  of  this  type. 

The  computations  reported  below  were  performed  on  the  IBM  370/158  at 
Brown  University.  The  goal  of  our  numerical  efforts  was  to  test  convergence 
properties  of  the  estimation  algorithm  on  selected  examples.  This  was  done 
in  the  following  manner.  "True"  values  of  the  parameters  to  be  estimated 
were  chosen  and  an  independent  method  was  used  to  integrate  the  systems  with 
these  values.  These  "exact"  solutions  or  these  solutions  with  random  noise 
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added  were  used  as  observed  "data"  (a  number  of  "sample"  data  points  were 
chosen)  and  the  spline-based  methods  were  employed  with  a  least  squares 
criterion.  For  a  given  N,  an  IMSL  package  (ZXSSQ)  for  the  Levenberg-Marquardt 
method  was  used  to  iteratively  find  the  corresponding  parameters. 


Example  4.1.  (Nonlinear  pendulum  with  delayed  damping). 

We  consider  the  system 

x(t)  +  kx(t  -  r) +  (g H)  sin  x(t)=0  ,  0  £  t  £  7  , 

x(0)  -  1,  0  <  0, 

x(0)  =0,  0  <  0. 


"Data"  consisting  of  28  sample  points  at  times  in  [0,  7]  were  generated  for 
"true"  values  r  =  2,  k  =  4,  and  g/i  =  9.81.  Several  different  estimation 
problems  were  investigated. 

(a)  We  seek  to  estimate  r  with  k  »  k,  g/i  *  g /i  given  (start-up  value:  r°  •  2.3), 
— 'N 

We  denote  by  r  the  "converged"  values  for  r  corresponding  to  a  fixed  value 
N  of  the  approximation  index. 

N 


2 

4 

8 

16 

32 


2.429 

2.412 

1.908 

2.003 

2.002 


(b)  We  estimate  r,  g/i  with  k  -  k  given  (start-up  values:  r°  ■  2.2,  (g/i)° 
8.6).  For  N  -  16,  we  obtained  r^  «  2.002,  g/i^  m  9.84. 


(c)  We  estimate  r,  k  with  g/i.  *  g/i  given  (start-up  values:  r°  »  2.5,  k°  -  8.0), 


For  N  «  16,  we  obtained  -  1.999,  k^ 


3.977. 
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Example  4.2. 

The  nonlinear  nonautonomous  multiple  delay  equation  for  consideration  is 

.  3x(t  -  r2) 

x(t)  --tx(t)  +  2*(t  -  rx>  +  K-T-x(t-.-rT  ,  0  <  t  <  4  , 


(-me,  -  2  <  0  <  0  , 

20  +  m8  ,  -  4  <  0  < 


x(e) 


-  2. 


"Data"  were  generated  for  16  sampling  times  in  [0,  4]  using  true  values  r  ■  1, 
r2  *  2,  K  *  10,  m  =  5.  The  following  problems  were  studied  and  results  obtained. 


estimate 

ri»  r^  with  K  ■  K, 

m  =  m  (start-up  values:  r^  ■  .5, 

— N 

-N 

N_ 

rl 

r2 

✓ 

2 

1.055 

1.600 

4 

1.013 

1.896 

8 

1.007 

1.943 

16 

.9995 

2.003 

32 

.9998 

2.003 

estimate 

K  for  ^  -  rx,  r2 

*  r2,  m  ■  m  (start-up  value:  K°  ■ 

N_ 

2 

4 

8 

16 

32 


8.345 

9.706 

9.816 

10.027 

9.9998 
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(c)  We  estimate  m  for 


rl»  r2 


r^t  K  =  K  (start-up  value:  m 


4.0). 


N 


-N 


a 


2 

4 

8 

16 

32 


5.114 

5.028 

5.014 

4.998 

4.999 


(d)  We  repeat  the  calculations  of  (c)  except  we  corrupt  the  data  with  random 
noise  (Gaussian  with  zero  mean  and  standard  deviation  a  =  .1). 


2  5.059 

4  4.973 

8  4.956 

16  4.940 

32  4.940 

Example  4.3 

We  consider  next  the  linear  multiple  delay  example 

x(t)  *  -  ^x(t)  +  0x(t  -  r^  +  x ( t  -  r2),  0  _<  t  £  3, 

x(6)  =  a02  -  30  ,  -  4  <  0  £  0  . 

"True"  values  of  8=3,  r^  =  1,  r2  ■  2,  a  ■  -.75  were  used  to  produce  24  data 

points  on  the  interval  [0,  3]. 
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(a)  We  estimate  a  for  6  *  6,  r  *  r2  «  r2,  (start-up  value:  a°  -  5.0), 


N_ 

2 

4 

8 

16 

32 


-N 

a 

-.661 

-.724 

-.742 

-.748 

-.749 


We  estimate  r 

r2,  8  with  a  ■  a 

(start-up 

values:  r®  ■  1.3,  r®  ■  1. 

6°  -  3.5). 

-N 

-N 

N_ 

rl 

r2 

bn 

2 

1.1233 

1.600 

3.1642 

4 

1.0028 

1.957 

3.0323 

8 

.9993 

2.009 

3.0064 

16 

.9996 

2.005 

3.0007 

32 

.9998 

2.002 

3.0000 

We  repeat  the 

calculations  of  (b) 

with  data 

that  has  been  corrupted  1 

noise. 

-N 

-N 

N_ 

ri 

r2 

IN 

2 

1.096 

1.600 

3.152 

4 

.9998 

1.970 

3.023 

8 

.9940 

2.024 

2.994 

16 

.9934 

2.025 

2.987 

32 


9941 


2.023 


2.987 


As  our  final  example,  we  present  a  multiple  delay  equation  with  nonlinearity 
satisfying  only  a  local  Lipschitz  condition. 

x(t)  *  -  1.5  x(t)  -  1.25  x(t  -  r^)  +  cx(t  -  sin  x(t  -  r t  0  £  t  <  5, 

x(0)  =100  +  1,  0  jc  0. 

True  values  were  c  =  1,  r^  =  1,  =  2,  and  data  were  generated  corresponding 

to  20  sampling  times  in  [0,  5].  We  estimated  r^,  r^,  c  with  start-up  values  of 
r°  «  1.4,  r°  *  2.2,  c°  =  .2. 


N_ 

-N 

r. 

-N 

r_ 

— N 

1 

2 

c 

2 

1.0814 

1.9863 

1.0606 

4 

1.0537 

1.9900 

.9757 

8 

.9998 

1.9906 

.9745 

16 

.9992 

1.9993 

.9981 

32 

.9996 

1.9995 

.9986 

TO.? 


standard  norm  on  R  ,  r»  *  or  generally  L”(a,  b) 

or  on  Z  «  Rn  x  l”(-  r,  0) 

standard  norm  on  ry,  0) 

(q)  weighted  norm  on  Z 

standard  norm  on  X(q)  ■  Rn  x  l”(-  r^,  0) 

P (q)  weighted  norm  on  X(q) 

p(qN)  weighted  norm  on  either  l"(-  r^,  0)  or  X(qN) 
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